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Curriculum Reformulation: 
Incorporating Technology into Science Instruction 

Abstract 

To increase the connection between educational research and educational practice, we used a 
process called "cuniculum refonnulation" to incorporate recent advances in research on learning 
and instruction into science classroom experiences. We successively refined the cognitive 
demands of a theraiodynamics curriculum while maintaining the same microcomputer based 
laboratory (MBL) software and the same basic experiments. We reformulated the 13 week 
curriculum four times, and, evaluated each version using the same criteria. Overall, we achieved a 
four- to ten- fold increase m snident learning (depending on the criteria applied) as a result of 
reformulations based on cognitive research. Our results showed that some principles from 
research offer promise for realistic settings and others such as "offer multiple representations*' are 
wrong or incomplete v/hen applied in realistic settings. 
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Curriculum Reformulation 

Educational leaders fitquendy call for closer collaboration between educational research and 
educational practice. Recent reports stress the need for investigations testing ideas from 
educational research in realistic settings (Linn, 1987*at 1987-b; Pea & Soloway, 1987). Two 
major problems thwart efforts to couple educational research wi^h educational practice. The first is 
meUiodological. Studies in realistic settings are influenced by numerous factors, and often the 
effect of research*based innovation cannot be detected. The second is conceptual Although 
research on learning and instruction has advanced substantially in recent years, cuxricular 
prescriptions remain imprecise. In fact, at times different research perspectives recommend 
conflicting educational practices. 

In these investigations, we combined advances from research on learning and instruction with 
advances in educational technology. Our goal was to improve students' understanding of aspects 
of thcmiodynamics, in particular the distinction between heat energy and temperature. The 
technological advance we studied, real-time data collection, is the ability to collect, record, and 
instantaneously display laboratory data. Use of such a tool frees students from the tedium of 
recording, analyzing, and displaying data. The challenge to curriculum designers involves taking 
fiill advantage of this capability in teaching students about thermodynamics. The advances in 
research on learning and instruction we incorporated characterize the learner as a) actively 
constructing a view of the natural world, b) coming to science class with isolated conceptions 
rather than integrated ideas, c)'kenefitting from robust models of scientific phenomena, and d) 
capable of learning self-monitoring skills (Eylon & Linn, in press). We used the process of 
cuniculum reformulation to evaluate our effects. 

We employed curriculum reformulation to address the methodological and conceptual problems 
of conducting investigations in realistic settings. Methodologically, rather than contrasting the 
"traditional** curriculum with the "innovative" curriculum, we contrasted successive reformulations 
of the innovative curriculum with each other . Conceptually, we evaluated each version of the 
curriculum, analyzed its shortcomings, sought guidance from research on learning and instruction 
to improve the curriculum, and evaluated the reformulated version. 
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Methodology 

Methou. used for * omparisons of traditional and innovative cunicula generally place tiie 
innovation at considCTable disadvantage. Often these studies attempt to ''keep everything else the 
same** and therefore they retain the goals of the traditional curriculum while adding some 
innovation. For example, studies add real-time data collection to a unit on thermodynamics but 
otherwise do not take advantage of the technique. Alternatively, studies change many aspects of 
the instroction making causal attributions problematic. As Cronbach (1963) discussed, 
comparisons of innovative curricula to established approaches often provide weak or useless 
information about the irmovation. Essentially, hundreds of factors influence performance in 
realistic settings. Many of these factors interact with the irmovation. If these interactions are 
suppressed, the innovation has very little effect If these interactions are permitted, the namre of 
the innovation changes, and the goals of instruction may change. 

For example, consider the familiar debate about using calculates to teach long division. If die 
**innovative'* curriculum adds calculators and makes no other changes, students in the irmovative 
program will spend less timeleaming division and will be faster and more accurate than those in 
the traditional program on tests where calculators are permitted Of course, when required to solve 
division problems without calculators, those who never used calculators will probably excel. 
However, smdents who use the time saved from drill on long division to leam estimation and 
answer verification may excel at solving naturally-occurring division problems under pressure, 
with or without calculators. Investigations of the effectiveness of instruction in realistic settings 
must be sensitive to the trade-offs between one instructional approach and another. Curriculum 
reformulation aUows investigation of each instructional approach. 

Results from investigations in realistic settings can infomi policy makers and other decision 
makers. All such studies must be evaluated in conjunction with the goals of instruction. Thus, 
adding calculators to instruction in division offers an opportunity to change the goals of instruction 
to include estiniation and answer verification. Naturally, policy makers ultimately select ft-ora 
several possible instructional goals and alternative versions of curricula. Besides evidence from 
trials in realistic situations, such decisions are bas:ed on costs, availability of trained personnel, and 
a variety of other evidence. 
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Conceptualization 

Applying educational research to cuiriculum design involves complex decision making. 
Cuniculum design involves thousands of decisions idiat ideally follow from it^earch on leaining 
and instrucdon. Firthemiore, principles ofleaming and instruction are constandy evolving. The 
principles enumerated here have empirical support, but are not fully understood For example, the 
motivational value of hands^n learning is well documented, but the mechanism leading to 
increased motivation in hands-on situatiras h&a not been fiilly spcdRcd (Lepper, 1985). 
Educational prnciples, therefore, provide guidance for the design of a physical science cuniculum 
but leave many questions unanswered 

Several models for combining research principles with cuniculum design are possible. We 
chose to combine the e)q)ertise of our project team to define the initial version of the curriculum and 
then to seek guidance from research after evaluation of the outcomes. Tlius, the first version of the 
Gnnputer as Lab Partner curriculum incorporated principles from research and irisights from 
educational practice. A more theory-driven approach was taken by Anderson's group at Carnegie 
Mellon University for devising computer tutors. They started with the principles from ACT* 
theory (Anderson, 1983) andiised these principles to govern instructional design as much as 
possible. (ACT* is **the most recent in a scries of theories denoted by the acronym ACT. The 
acronym stands for Ads^tive (Control of Thought, a name that has only historical significance.** 
(Andenon, Boyle, & Reiser (1985)) Nevertheless, both Anderson's group (Lewis, 1987) and our 
group report that curriculum design involves thousands of decisions, many of which are not 
addressed by relevant research or theory. 

The Computer as Lab Partner Curriculum 

The first of four versions of the Computer as Lab Partner Cuniculum combined the teacher's 
commitment to hands-on, interactive learning and the researcher's perspective of the learner and of 
instruction. This section describes the rationale for the initial curriculum. Preliminary versions of 
the student activities used hardware and software donated to the project and were devised jointly by 
the teacher, researchers, and physics experts who participated in the project. Tlie science topic, 
experiments, technological environment, and classroom environment remained constant through all 
of our investigations, as did the teacher role and student characteristics. We varied the intellectual 
demands on students as we refined the curriculum in light of principles from research. 
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Science Topic 

We focused our investigation on an inq)ortant scieiiofic domai^i - - thermodynamics. Science 
educators and cognitive researchers generally agree that efforts to understand and improve science 
education should focus on fundamentally important knowledge domains. Since much of scientific 
knowledge is specific to the problem contcxtt students develop conceptions of scientific problems 
that can inhibit or enhance subsequent learning (e.g.. Centner & Stevens, 1983; Larkin, 
McDennott^ Simon, & Simon, 1980; Linn & Swiney, 1981). Furthermore, instructional 
provisions, including the strategies necessary for problem solution, vary with the scientific domain 
(e.g., Reif, 1987; Brown, Kane, & Echols, 1986). 

We selected thermodynamics for several reasons. Hnt, thermodynamics is fundamental to 
much of physical science. The concept of energy and the distinction between intensive and 
extensive properties contribute to many domains. Second, students encounter many naturally* 
occurring problems involving thermodynamics, such as conservation of energy in home heating 
and cooling, maintenance of body temperature, and cooking with microwaves, which primarily 
add energy to water and fat i^lecules. Third, thermodynamics involves many observable 
influences and is readily ac^ssible to experimentation. Students can use microcomputer-based 
laboratories to collect information about htating and cooling and can easily conduct experiments 
involving state changes such as the freezing and boiling of water or alcohol. For eighth-grade 
physical science, we sought a topic familiar to students, readily encountered in natural settings, 
appropriate for middle school, and amenable to available technology. The general topic of 
thermodynamics met these criteria. 

Activities 

We devised a scries of hands-on experiments that were feasible in the classroom and relevant to 
thcraiodynamics. The actual cumculum focused on the distinction between heat energy and 
temperature and on the process of state change. Examples of state change included (a) freezing of 
paradichlorobenzine, (b) the freezing of water, (c) boiling of water, and (d) boiling of alcohol. 
Activities were selected from experiments used previously by the instructor or devised by the 
research team. As can be seen in the summary in Table 1, me activities were modified slighdy 
from version to version of the curriculum, but major changes were not made. 

Our choice of hands-on learning experiences reflected the considerable research demonstrating 
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that students devote their full attention to hands-on leaming experiences and report enthusiasm for 
these activities Q^ational Assessment of Education Progress [NAEP]> 1979a). Hands*oa 
approadies to science instrurdon maintain high modvation among students and often teach science 
effectively (Shymansky» Kyle» & Alport, 1982). On balance, hands-on leaming requires 
considerable instructional time and may fail to communicate the appropriate problem representation 
and fail to encoyrage integration of knowledge. Often students in hands-on classes leam to break 
glassware or create bubbly mixtures, but not to relate their experiments to any scientific principle 
Qliiui, 1980). Furthermore, many important scientific phenomena are not amenable to in-class 
experiments. In light of this situation, we sought guided discovery experiences that comlnned 
rtal-time data collection with n emphasis on an effective representation and in .egrated 
understanding to achieve effective learning. 

It should be noted that the curriculum devoted 13 weeks to heat eno^gy and temperature. In 
contrast, the textbook for middle school physical science recommends devoting approximatdy one 
week to this topic. Furthermore, the textbook treatment involves the distinction between heat 
energy and temperature as we|l as state change, specific heat, thennoconductivity, and kinetic 
theoiy. The textbook approach is fundamentally in conflict with the principles of leaming and 
instruction governing our investigation: The textbook overloads students' processing capacity, 
focuses on isolated facts, and fails to provide an appropriate representation for the distinction 
between heat energy and 'temperature. Although our approach differed substantially fix)m that 
commended by the textbook, it was not a radical change for the participating teacher, who 
generally focused on a few topics and used hands-on experiments. 

Technological Environment 

To study thermodynamics at normal pressure, expert scientists often use real-rime data 
collection. This tool is available to students through software developed by Technical Education 
Research Centers (l^ERC) in Cambridge, Massachusetts, and (originally) published by Human 
Resource Media [now Queue] (1987). Other companies also offer similar software (e.g., 
Broderbund, 1987). Adaptation of technolo^cal tools used by experts for classroom instrucrion 
offers considerable promise over earlier approaches for using technology in education (Linn, 
1987b; Linn, 1988). 

In our curriculum, the computer becomes a silent lab partner. Students can conduct heat and 
temperature experiments, collect data in real-time, display the data, and print graphs of the data 
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using the Apple lie computer (see Figure 1). This environment resulted from an equipment giant 
from Apple Compr.icr and a gift of pre-releascd software from TERC, as well as an Educational 
Technology grant irom the State of Califomia to buy final versions of the software. 

The real-time data collection environment supports the active, constructing nature of die 
learner. First, real-time data collection provides memory support and firees the student to 
concentrate on integrating ideas. Real-time data collection speeds up experimentation and increases 
efScient use of limited classroom time, allowing students to repeat their experiments to resolve 
ambiguities even in a single class period. 

Second^ real-time data collection encourages understanding of grq)hs of heating and cooling by 
dynamically displaying changes over time. Smdents note when the temperature changes rapidly 
and when it changes slowly or does not change at all, often remarking, **Lx)ok, now the 
temperature is changing fast; now it's slowing down." 

Third, real-time data collection Aelps students develop robust understanding of heat energy and 
temperature by providing multiple representations of heating and cooling. Smdents have a concrete 
representation of their experiment and they have graphic representations of the data. In addition, 
by representing many diffcrtm experiments on the sbxdc axes and with the same format, students 
can easily compare one experiment to another and potentially integrate their understanding of 
thernxxlynamics. 

Founh, using real-time data collection enhances hands-on interacti^ : learning. A long research 
tradition demonstrates that feedback helps students learn (e.g., Greeno & Simon, 1984). 
Traditionally, science teacher^have provided feedback for students through tests and worksheets 
and through class discussions. Using real-time data collection, students gain feedback througl^ 
graphic representation of theii data, and opportunities to re-display information gathered from 
varied experiments. 

Real-time data collection also makes it easy for students to give feedback to peers. When using 
computers in the science classroom, opportunities for peer interaction include collaborative reports 
using the wordprocessor and easy access to computer screens displaying data collected by other 
students. As yet, this feedback is not well understood (Webb & Lewis, in press) and techniques to 
take advantage of peer interaction are still developing (e.g., Lambiotte, et al. 1987; O'Donnell, 
Dansereau, Hall, & Rocklin, 1987, Brown & Palinscar, 1987). 

Fifth, real-time data collection provides opponunities to learn about scientific measurement. 
By calibrating the probes used for real-time data collection, students leam about error of 
measurement. When reconciling their results with those of other students, they realize that some 
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differtnces in outcome arc attributable to calibration. Students also confront the problem of 
accuracy of measmtment when they note irregularities in heating and cooling curves caused by ±t 
pixel density on the computer screen. Real*time data collection allows students to examine effects 
not often studied in science classes. For example, they can investigate the effect of stimng a 
heated liquid on the unifomiity of temperature throughout the material 

In summary, the technological environment facilitates experimentation, helps students build 
robust representations of the phenomena under investigadon, and supports effective hands-on 
learning. 

Classroom Environment 

Instruction took place in a one-semester (20 week) physical science class, with each class 
period about 55 minutes long. Qasses met six out of every seven school days. The district 
follows a modular schedule which allows students to participate in seven classes even though they 
only schedule six class periods daily. Four classes participated each semester. 

Students learned science using a double classroom. One classroom was used for written 
assignments and class discussion. The other was used for experimentation. The computers were 
arranged around the room, one to a table. Printers were located centrally. Students needed to save 
their results and then take them to a computer with a printer. 

Students conducted experiments using the computers as lab partners about every other day. 
Apparatus for experiments included bunsen burners for heating liquids, insulated containers, and 
containers of many different sizes. Students experimented with hot water, ice water, ice, and a 
variety of different sub'-ances including oU, alcohol, and paraiichlorobenzinc. They gathered 
equipment needed for their experiments from a central location, set up their experiments, and 
collected their data. Then they prepared written reports and participated in discussions about their 
findings. 



Teacher role 

Initially, the teacher maintained his usual role. The teacher was experienced in managing 
hands-on learning, and found that real-time data collection simplified experimentation. The teacher 
modeled effective problem solving, encouraged student pairs to discuss their plans and their 
results, devised team response sheets to encourage interaction, and monitored student behavior 
during experimental sessions. The real-time data collection techniques made monitoring student 
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perfonnance easier because results were displayed on 16 computer screens around the room. 

Self-Monitoring. TTiis teacher role is compatible with recent research on instruction, 
demonstrating that students* self-monitoring skills contribute to learning (Brown & Palinscar, 
1987). Brown and her colleagues have demonstrated that teachers can model self-monitoring skills 
and, with appropriate scaffolding, can instill them in students. As students develop skills in self- 
monitoring, they learn to analyze different perspectives on the same underlying phenomena, test 
their ideas, and eliminate conceptions that lack predictive power. 

In the Computer as Lab Partner curriculum, several factors encouraged effective self- 
monitoring. First, the teacher modeled his own problem-solving processes, describing how he 
monitotecl his ideas and con^ared results from different experiments. Second, the hands-on 
experience available in the classroom also encouraged self-monitoring because students had 
concrete results to compare to their verbal explanations for concepts fronc thermodynamics. Third, 
real-time data collection procedures encouraged self-monitoring, in that they provided a new 
representation of valid dataf6r students to examine. 

Student Characteristics 

The participating students came from a middle class, racially and ethnically mixed community. 
About one-third of the students reported some access to computers outside of school. 

Thermodynamics is appropriate for 12- to 13-year-olds, in that they have many concrete 
experiences relevant to it Funhermorc, students of this age should be transitional between 
concrete and formal operations, and therefore receptive to instruction which attempts to provide & 
more systematic understanding of heat energy and temperature (Inhelder & Piaget, 1958). 

Requisite Knowledge. Most would agree that there are prerequisites to any instruction 
(e.g., Gagne» 1968). To use real-time data collection, students need skill in interpreting graphs 
presented on the computer as well as skill in evaluating the reliability and validity of computer 
presented information. Thus, we focused on this information at the beginning of the course and 
assessed whether students had acquired it 

Domain Knowledge. Much research reveals that students need approprate knowledge 
about the situations in which concepts or principles are applied in order to reason effectively about 
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those concepts (Greeno,1986). In particular, students cannot design fair comparisons when diey 
do not know which variat^les to keep the same (Linn & Swiney, 1981). Our curriculum focused on 
experiments conducted in die science classroom. To ensure that students understooi the situation, 
we emphasized each of die variables diat diey could investigate. Thus, they learned about die 
problem situation including the role of each variable influencing aspects of heat transfer and 
temperature. In general, students found these sicuations unique and had few expectauons about 
outcomes. 

Gassroom teachers, philosq)hers, developmental psychologists and others agree that learners 
actively construct an understanding of scientific phenomena (Resnick, 1983) and enter science 
classes with well-estabhshed ideas about scientific phenomena, including thermodynamics. 
Effective instruction must take advantage of the active constructing nature of the learner in order to 
improve scientific reasoning and problem solving. In diennodynamics, students have difficulty 
distinguishing heat energy from temperature (e.g. )^scr & Carey, 1983) and have isolated ideas 
diat are not readily integrated (Brook, Briggs, Bell, & Driver, 1984; Tiberghien, 1983). 

In addition, many snidies reveal diat students construct specific ideas about scientific 
phenomena which govern di^ reasoning in naturally-occurring situations, even if instruction 
offers a different perspective (e.g.. West, Pines, & Sutton, 1984; Driver, 198^). Students have 
very clear ideas about naturally-occuiring problems involving heat energy and temperature (Table 
2) but do not necessarily f^ply diese ideas to classroom experiments. Thus, students believe diat a 
larger cup of hot chocolate has a higher temperature than a small cup of hot chocolate, and that 
sweaters keep people warm a^d Uiercfore cannot be used to keep an ice cube from melting. 
Initially, our curriculum emphasized understanding of heat and temperarare experiments students 
conducted in class since these were accessible to experimentation. Ultimately, we intend to help 
students apply their understanding to naturally-occurring problems, (see Songer & Linn, 1988a). 

The Computer as Lab Partner: Version One 
The goal of the first version of the Computer as Lab Partner curriculum was to impart 
integrated knowledge of heat energy and temperature. Based on research on scientific 
understanding, it is clear that neither requisite knowledge nor domain knowledge are sufficient for 
learning to distinguish heat energy and temperature. Researchers generally agree that students need 
coherent understanding of a class of problems rather than isolated understanding of individual 
problems in order to garner knowledge (e.g. Linn, 1987a). In contrast, students often develop 
separate representations for problems that have the same underiying structure (di Scssa, in press; 
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Eybn & Luuit in press). Essentially, students learn to solve a problem in a particular context or 
situation and fail to recognize which infonnadon is ess^dal and which is peripheral Therefore, 
they treat problems as dissimilar diat, in fact, could be integrated By integratinc understanding of 
seva-al problems, students not only recognize the essential features, but also build representadons 
diat more readily incorporate subsequent related problems. 

Although reseaicheis stress integration, diey o£fer minim?! guidance on how to achieve it 
Many reseatchers believe diat effective instuction involves integrating domain knowledge by 
providing students with an aiq)n>priate "^ntal model** of die phenomenon under study (Genmer & 
Collins, 1985; Rouse & Morris, 1986). Mental models include domain knowledge as discussed 
above (e.g., the relative insulating value of different materials), procedures (e.g., techniq jes for 
sep^ting intensive and c .tensive properties), and plans that combine domain knowledge and 
procedures to yield problem solutions (e.g., predicting whedier a small glass casserole or a larger 
jittal casserole will stay warm longer). Thus, mental models help students relate the various 
aspects of heat energy and ten^)erature into a coherent view and provide systematic ways to use 
this coherent view to solve problems. 

In designing this course'/we ccxisidered four possible models or representations (summarized 
in Table 3) to help students develop integrated understanding of heat ener:g: i and temperature. 
Three of dicse models appeared in textbooks for students in middle school: measurement, 
variables, and kinetic theory. The fourdi, based on heat flow, is similar to the historic view of heat 

as the calorie, but stresses that heat lacks mass. 

.< 

InitiaUy , the teacher retained die measurement representation, having students compute changes 
in degrees and changes in calories. This was accompanied by a verbal description of the kinetic 
Ibfi. T model In all versions of the cuniculum, we emphasized the variables involved in changes 
in heat energy and temperature to provide domain knowledge but not as an explanation of the 
distinction between heat energy and temperature. Fundamentally, only die kinetic dieoiy and heat 
flow models offer an adequate explanation of the heat energy and temperature distinction. 

Method 

Using the activities, technological environment, and classroom environment described above, 
and starting with the teacher role and student characteristics deflned above, we tested and refined 
the first version of the Computer as Lab Partne*'' curriculum. Four separate cohorts of 128 eighth- 
graders participated in the four investigations. Between curriculum versions, we modified the 
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intellectual demands on students, but not the experiments or the software, in order to improve 
learning outcomes* 

The first version offhecurncdum included die hands-on e;q)^^ The 
cuniculum emphasized knowledge required to take advantage of real-time data coUecdon. 
Activides designed to teach students how to internet con^uter-presented gnphs and how to 
analyze the reliability and validity of con^uter-presented informadon were included. This efifort 
has been reported elsewheit and is summarized here (see Linn, Layman, & Nachmias, 1987; 
Nachmias & Linn, 1987). . 

In addition, the curriculum helped students acquire domain knowledge relevant to 
thermodynamics because smdents conducted experiments investigating how each variable 
influenced heating and cooling. 

Assessment To assess student understanding of thermodynamics, we used the Heat and 
Temperature Assessment (HTA) each semester we offered die Con^uter as Lab Partner 
curriculum. This assessment^consisted of questions about domain knowledge, as well as a 
general question about the distinction between heat energy and temperature. See sample item in 
Hgure 3, 

Scoring. HTA items were coded according to qualitative distincticns agreed upon by several 
members of die research team. To score domain knowledge, questions about **volume** and 

"insulation** and dieir influence on heating and cooling were marked as pass or fail. Responses to 

.1 

the heat energy and temperatifre distinction question were classified into seven categories. These 
categories were: (1) very good distinction (including at least two clear and accurate qualitative 
distinctions and/or good example), (2) complete distinction (at least one clear and accurate 
qualitative distinction), (3) some distinction (one vague but correct qualitative distinction), (4) 
sin^e diermal distinction, (5) textbook definition or teims only, (6) no difference, confused, or 
wrong and (7) no response. Ambiguous answers were reviewed by at least two coders and 
resolved by group discussion. 

In order to fully characterize understanding of the distinction between heat energy and 
temperature, two levels of coding criteria were realized: a weak criteria and a strong criteria. In the 
weak criteria, the seven categories of student answers were divided into four groups: no response, 
wrong, incomplete, and good. Wrong responses were those cliaracterized as "no difference" or 
**confused" (6 and 7 above). Incomplete responses were those characterized as single thermal and 
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textbook tenns only (4 and 5 above) Good responses included at least one accurate qualitative 
distinction (1,2, and 3 above). Sample responses appear in Table 4. The second criteria, tiie 
strong criteria* placed students in two groups. All students who were able to make at least one 
clear and accurate qualitative distincti<xi, and/or dte an example of their distinction, were 
characterized as successful (1 and 2 above). 

Design. During the first semester of the Computer As Laboratory Parmer (CLP) curriculum* 
we established aperfomumce baseline by administering the assessment to students slated to take 
the course during the second semester. Subsequendy, we administered the assessment at the end 
of the course. 

Results and Discussion 

Before detemiining whether students gained integrated knowledge, we assessed whether the 
curriculum was unplemented as planned, whether students could inteipret the graphs presented by 
the software, and whether the coaq)uter-presented inforatiation made sense to the students. We 
then assessed students' doiq^in knowledge and their abili^ to distinguish heat energy and 
temp^ture, our measure of integrated understanding. 

Implementation. During the first semester we were successful in implementing the 

« 

interactive and hands-on aspects of the classroom environment In contrast, UiC technological 
environment presented difficulties. Probes broke, software crashed, and computers needed repair. 
These problems distracted botji' the teacher and the students, and no doubt interfered with 
acquisition of robust understanding. 

Knowledge of Graphing. As reported by Linn, Layman, and Nachmias (1987), students 
acquired understanding of graphing fiom the curriculum. Smdents became proficient at 
interpreting computer-presented graphs, explaining 80% of die heat and temperature graphs 
correctiy. These results are consistent with other studies of real-time data collection (e.g., Brascll, 
1987; Mokros & Tinker, 1987). Remarkably, studentr transferred their understanding of graphing 
to motion experiments. Students using real-time data collection were significantiy better than 
others at interpreting graphs of, for example, the speed of a bicycle going up and then down a hill 
over time, even though no instruction on interpreting graphs involving motion was offered (see 
Linn, Layman, & Nachmias, 1987 for details). 

Interpreting computer-presented information. Students also became more proficient at 
recognizing reliable and valid information as a result of experience with the Computer as Lab 
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Partner curriculum. As reported by Nachmias and Unn (1987), students learned (a) to recognize 
when their experimentd set-^ups were incontct und (b) to detect when graphs had gone ofif either 
die upper or lower scale on the screen. Students had greater difficulty interpreting fluctuaticMis in 
graphs due to pixel density on the screen or due to die calibration of the measuring device. As a 
result, subsequent versions of die cuniculum increased emphasis on these topics* 

Domain knowledge. Students acquired domain knowledge in that they recognized die role 
of the variables they investigated. As shown in Hgure 4, over 75% of the students understood the 
role of the variables they had smdied in heating and cooling, conq)ared to a baseline of 50%. 

Distinguishing Heat Energy akid Temperature. Students made litde progress in 
distinguishing heat energy ano temperature, as shown in Hgures 5 & 6. Rrior to instruction, 
students had virtually no ^mdentanding of this distinction: Only 3% of stqdents met the strong 
criteria (Figure 6). This finding is consistent with a wide range of investigations of students* 
conceptions of heat energy and temperature (e.g., Tiberghien, 1980, 1983; ^ser & Carey, 1983). 
After instruction, 1 1 .7% of the students met the strong criteria for distinguishing heat enw^gy and 
temperature (Hgure 6). Qose to 40% of students gave incorrect or confused answers and 17% 
gave no response at aU (Figure 5). Of those who responded, 14% indicated that heat and 
temperature comprised a single thermal concq}t, perhaps suggesting that heat measured die 
temperamres above warm and that temperamre was all the degrees on die spectrum (see Table 4 for 
examples). A small percent (10%) of students hinted at die intensive versus extensive properties of 
heat and temperature by sav*ng dungs like **Heat is what is given off by somediing, and 
temperature is the measun. ci ^ w^jt ir or ®F.** Qearly, this distinction presents difficulties for 
students. 

In sununary, the firsi ve-N^cr the Computer as Lab Partner cuniculum implemented die 
desired classroom env>r ;>n "-^^nt, providing an interactive, hands*on approach to learning. Results 
for diis version demonstrated that students have no difficulty learning to inteipret real-time data 
collection experiments, consistent with other investigations. As expected, students gained 
familiarity with die variables involved in heat energy and temperature, but made limited progress in 
achieving a coherent, integrated understanding of the distinction between heat energy and 
temperature. An unanticipated result was that investigations of heating and cooling communicated 
robust understanding of graphing that generalized to experiments concerning motion. 

The Computer as Lab Partner: Verslcn Two 
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G>ntinuing with our goals of izx^arting integraied understanding of heat energy and 
temperature and using results from version cme, we reformulated the Conq)uter as Lab Partner 
curiculum and tested the effectiveness of the revised version with a new groiq) of students. We 
increased emphasis on areas where requisite knowledge was weak, expanded domain knowledge, 
and sought new ways to help students to integrate their understanding and develop a robust 
representation for heat energy and temperature. 

In version one, we found that die kinetic theoiy representation, combined with the 
measurement representation, was not sufficient to help students distinguish heat energy and 
temperature* We sought a noore powerful representation of this distinction, adding botii qualitative 
and quantitative components. In designing an appropriate representation for heat energy and 
temperature, we sought a qualitative model that would be accessible to middle school students ana 
would unify the experiences in the curriculum. We focused on heat flow and offered a definition 
of heat reminiscent of the historical concept of the caloric. In contrast to the historical notion that 
the caloric had mass, we stressed that heat was massless. Quantitatively, we continued to 
emphasize computation of changes in calories, and the implications of these changes on 
computation of changes in d[egrees centigrade. 

In version one of the Computer as Lab Parmer curriculum, the teacher had difficulty 
implementing his usual techniques for encouraging students to integrate their ideas due to logistic 
problems. In version two, k'' instituted the techniques he generally uses to help students integrate 
their understanding of scientific principles. He presented challenging questions at the beginning of 
each lesson, encouraged grou^ discussion, and modded his own thought processes. He 
encouraged joint problem-solving and group reports. Response sheets were revised to reinforce 
integration of understanding. 

In summary, version two of die curriculum addressed the difficulty of understanding 
calibration, extended coverage of variables relevant to the domain, and encouraged students to 
develop robust models and integrated understanding of heat energy and temperature. The other 
effective components of the curriculum were retained 

Method 

Technological Environment. For version two, the project received a donation of 
wordprocessing software from Apple Computer. As a result, several student activities were altered 
so that parmers could generate joint reports using the wordprocessor. 
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In addition » calibndon activities were increased 

Domain Knowledge. Because students readily learned about the variables influencing the 
sihiations they were studying, we added starting temperanue to the variables studied. Knowledge 
of the role of these variables was not sufficient to explain the distinction between heat energy and 
temperature. 

Assessment. The assessments used for version two were die same as those for version one 
except that the domain knowledge assessment was expanded to include starting temperature. 

Scoring. Consistent with the scoring of the other domain variables, knowledge of starting 
temperature and its influence on heating and cooling was coded on a pass/fail basis. 

Results 

Domain and Requisite Knowledge. Before assessing student gains in integrated 
understanding from the reformulated version of the curriculum, we first assessed domain and 
requisite knowledge, implementation, and the effects of using the wordprocessing. Results from 
version two replicated those from version one concerning domain knowledge (see Figure 4), 
knowledge of graphing, and jpiowlcdge of computer presented information. The revised activities 
succeeded in improving students' undentanding of calibration, as rqported by Nachmias and JJrm 

(1987) . As shown in H^ure 4, students made good progress in understanding the effect of 
starting temperature introduced in version two. 

Implementation* To assess implementation of the curriculum during this version, Striley 

(1988) closely observed dyad^of students conducting experiments. She found that students were 
almost always on-task in spite of the many potential distractions: Students needed to collect the 
materials for their experiments, to set up their experiments, and then to respond to questions on 
their activity sheets. During all of these activities, less than 1.5% of the time was spent off-task. 
Of the remaining time, 10.3% of student interaction was composed of discussion of experimental 
results and negotiation of understanding of investigations. The remaining 88% of the time students 
spent on the activities needed to conduct empirical investigations, including gathering equipment, 
setting up experiments, and recording results. 

Technological Environment. Students, working in dyads, took turns at the keyboard and 
bodi contributed to the final report. Striley (1988) observed students preparing reports by hand 
and using the wordprocessing software available during this semester. One unanticipated effect 
was that students collaborated more when preparing reports on the wordproccssor than tfiey did 
when preparing reports by hand. Typically, when students used pencil and paper to make reports, 
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one smdent answered the questions while anodier wrote down the answer. Often we heard 
students say, *Tou write, FU diinlc" When usmg the wordprocessor, students were more likely to 
work joindy to answer questions and were also ooore likely to revise their responses. 

Thus, using the wordprocessor to prepare lab reports facilitated knowledge integration. First, 
the wordprocessor permitted coUaboradve report preparation. Second, the wordprocessor made 
revisim easier and increased its frequency. Third, report preparation on the wordprocessor 
allowed the teacher to observe the process and discuss statements with students. The teacher 
modeled question-asking strategies that students began to implement as diey prepared their 
labOTatofy reports. 

Observations of students working in the classrocnn revealed another unanticipated effect of the 
technological environment Students frequentiy compared the results of their experinsents to tiiose 
of other students by glancing around the room at the computer screens. Furthermore, when 
students observed anomalous findings on another screen, they finequently gathered around to 
analyze the results. Thus, at times a community of scholars emerged as groups formed to discuss 
aberrant results. ^ 

Integrating Understanding. In spite of reformulations, students made littie gain in 
distinguishing heat energy fiom temperature from version one to version two. The teacher was 
able to implement techniques used in the past to encourage students to integrate dieir 
understanding, yet only slight gains over version one of the curriculum were recorded (see Figures 
5&6). 

.1 

Li version two of the cumculum, two representations for the distinction between heat energy 
and temperature were offered: one quantitative, involving measurement of calories and degrees, 
and one qualitative, involving heat flow. Some researchers believe that multiple representations of 
the s^uiie phenomenon facilitate learning. In our curriculum, the opposite seemed to be the case. 
Rather than integrating the two representations for heat energy and temperature, students appeared 
to prefer the quantitative approach, which in fact, offered a limited rq)resentation of the underlying 
phenomenon. Students seemed satisfied with their ability to compute a change in calories or a 
change in degrees and were not motivated to go beyond diese changes to find a mechanism to 
explain the difference between heat energy and ten^erature. As a resuk, a signiHcandy higher 
nur ber of students in version two were able to describe some distinction between heat energy and 
temperature (see Figure 5). However, the distinction was superficial, a common answer being 
'*Heat is calories, temperature is degrees." 

19 



Technology and Science Instruction 17 

Discussion 

Hie second version of the curriculum revealed serious difiBculties in impardng integrated 
understanding. First* students selected the simplest representation, rather than integrating the 
available representations. Students preferred the quantitative representation for its sin:q;)licity, not 
for its robustness. As Lewis (1987) ccmduded in evaluating the effectiveness of the algebra tutor 
developed at CMU, students are ^'cognitive economists'*. If a simple solution is available, they 
resist a more complex one. It seems tiiat the quantitative rqiresentation for heat energy and 
temperature provided an easy answer and :tood in the way of students' serious analysis of Ae 
distrnction. Many textbooks emphasize computation of gains or losses in calories and in degrees 
centigrade to represent heat and tenq)erature. Our results suggest that this quantitative 
representation of thermodynamics throws a veil of numbers over the distinction between heat 
energy and temperature and stands in the way of qualitative understanding because students fail to 
analyze the qualitative relationships. In contrast, experts tend to think qualitatively about physics 
problems while novices often Ihink quantitatively (Laridn, et al, 1980). As a result, we limited our 
presentation to qualitative re^sentations in subsequent versions of the curriculum. 

Second, in this version of the CLP curriculum, the teacher's proven techniques for helping 
students integrate their ideas dd not succeed. In the traditional classroom, students spend 
considerable time translating data collected firom experiments onto graphs. In the real-time data 
collection environment, such translation is unnecessary. Thus, traditional techniques do not take 
full advantage of real-time da£ collection. WhOe data was being collected, students rather 
passively watched the graphs appear on the screen although they were free to concentrate on other 
aspects of the experiment The third version of the curriculum sought to correct this situation. 

The Computer as Lab Partner: Version Three 
The first two versions of the CLP curriculum did not enhance integrated understanding in the 
form of improved ability to distinguish between heat energy and temperature, although they did 
instill (a) knowledge of graphing, (b) understanding of and computer-presented information and 
(c) domain knowledge appropriate for thermodynamics. Furthermore, although the program 
implemented efficient hands-on, interactive experiences and encouraged students to compose 
laboratory reports at the wordprocessor, it did not create robust understanding. 

It is exactiy this lack of integration of understanding that many implicate in the poor 
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petfonnance of American students on national science assessments. Furtheraioie, much research 
demonstrates that students rarely change their concepts about scientific phenomena (Eylon & linn, 
1987; Champagne, Klopfer, & Gunstone, 1982). It appears that students "learn" new scientific 
principles in class, but fail to apply them to subsequent problems. 

In spite of extensive research, we had limited success in the classroom. First, we sought 
inspiration from philosq)hers of science to understand conceptual change and find effective 
strategies for instracticm. Tliis research clarified the dilemma, but did not offer clear guidelines. 
Carey (1985) oxnpares changes in student's ideas during development to change in scientific 
understanding as described by philosopher of science Kuhn (1963). Several researchers have 
compared students' attempts to understand scientific phenomena witii the description of 
progressing and degenoating research programs offered by Lakatos (1972, 1976). These 
researchers argue that students selectively incorporate information much as scientists in the history 
of science have dealt with new results (Strike & Posner, 1983; Linn & Siegel, 1984). These views 
suggest the importance of offering an integrated, robust alternative view to the learner and are 
consistent with the obseivation that ^>parent contradictions to students' ideas are not sufficient to 
lead to concephial change (B^ubules & Linn, 1988). 

This research reiterates the importance of an appropriate representation for heat energy and 
temperature, and suggests how our representation could be augmented Thus, we focused on the 
heat flow representation of heat energy and temperature in version three to (a) offer a robust 
alternative to students* ideas, (b) avoid simplistic options like the measurement representation, and 
(c) avoid abstract options like^netic theory. 

The research tradition informing our reformulations was our second focus on the constructing 
nature of the learner. In version three we reformulated the curriculum to encourage students to 
actively integrate their understanding of heat energy and temperature. We obsenred that students 
could tolerate greater cognitive demands while conducting their experiments because real-time data 
collection took over functions that would have occupied them in a traditional class. We based our 
reformulations on two principles from research: active learning and self-monitoring. 

Research results recommended that students be actively involved in analyzing and integrating 
their experiences (Palinscar& Brown, 1984; Bereiter & Scarramalia, 1986). The teacher had 
attempted to achieve active, reflective learning through class discussion and work sheets. Students 
could also be actively involved in their experiments. For version three we generated two 
hypotheses about how students could actively analyze and integrate their experiences. First, rather 



Technology and Science Instruction 19 

than passively conducting experiments, students could actively record their observations just as 
expert scientists do. Second, rather than treating each experiment as unique, students could use 
the results of one experiment to predict die outcomes of the next Essentially, students could base 
their first prediction on concq)tions diey brought to science but would construct their second 
predicti(xi by integrating the results of their first experiment Thus students would be encouraged 
to engage in a progressing research program as described by Lakatos (1972,1976). 

Research also stresses the importance of self-monitoring fur achieving integrated understanding 
(Brown & Kane, in press, Schoenfeld, 1985). Self-monitoring involves assessing one's progress 
and redirecting one's energy based on feedback. Self-monitoring skills include a) rvxogniadng 
incomplete or inaccurate conclusions, b) locating the causes of errors, and c) anticipating future 
problems. Bodi die prediction and observation conditions provided opportunities for self- 
monitoring in diat students could compare tiieir observations or predictions to other infomiatioQ 
they had about thermodynamics. To encourage self-monitoring in version two, die teacher 
described his own self-monitoring activities. In version three he also encouraged students to 
engage in trial and refinement x>f ideas, and provided feedback on self-monitoring activities. 

' Prediction and Observation Conditions 
To encourage trial and refinement, both the prccliction and the observation approaches can take 
advantage of real-time data collection because students receive valid feedback on their 
investigations. The graphs of the experimental data that students print out are almost always valid. 
As a result, it is appropriate to reconcile predictions with outcomes and revise ideas. In contrast, 
when smdents write down measurements and then construct graphs, often the data lack validity. 
Furthermore, with real-time data collection, observations linking experimental events to changes on 
the graph are possible. Students can observe water boil and immediately note that the graph levels 
off. 

Both prediction and observation can also encourage self-monitoring. For prediction, self- 
monitoring results from encouraging smdents to explain discrepancies between predictions and 
outcomes, requiring pairs of students to reconcile their ideas. For observation, self-monitoring 
results from encouraging students to explain the relationship between changes in the experiment 
and changes in the graph. 
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Representation of Heat and Temperature 

As menticmed above, in version three we modified the itpiesentadon of heat and temperature 
we offered students by increasing emphasis on the qualitative relaticmships between die variables 
and dropping the emphasis on the quantitative relationships. Results for version two suggested 
diat quantitative relationships were not integrated with qualitative relationships and that the 
quantitative relationships we offered were selected over the more powerful qualitative 
representations. 

Gildea, Miller, and Wurtenberg (1988) report similar results fipom their attempt to provide 
multiple dictionary definitions. Rather than integrating the various definitions offered, students 
tend to select a single definition. Furthermore, rather than selecting the most useful definition, 
students tend to select whatever they perceive as the easiest definition. They tend to ignore 
definitions that place the word in the context of a sentence and instead select prototypic dictionary 
definitions. 

Method ^ / 

Design. In version three of the CLP curriculum, we instituted two conditions: the 
observation condition, where students carefully observed what happened in their experiments; 
and the prediction condition, which required students to predict outeomes based on previous 
results and reconcile their predictions with the results they observed. Because both of these 
conditions seemed promisingi^^Cve randomly assigned the four classes to either the prediction 
condition or the observation condition. Recall that classes rotate so students do not always have 
science at the same time of day, making this random assignment independent of time of day. 

Activities. We designed new versions of each activity to emphasize either prediction or 
observation. Examples appear in Table 5. 

As shown in Table 1, to increase emphasis on qualitative relationships, we included the surface 
area variable. We also increased emphasis on state changes and on more complicated situations, 
such as rate of cooling when a substance to be cooled was modified at several different points 
during the experiment 

Assessment To assess the effectiveness of the observation and prediction conditions, we 
added an activity called the swimming pool problem. In this problem, students were required for 
the first time to design and conduct their own experiment prior to describing their results. As a 
design and implementation activity, the swimming pool problem was a good assessment of 
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students' integradm of knowledge and their ability to q>ply general problem solving skills such as 
controlling variables* The activity is shown in Figure 8. 

Scoring. As with the previous donudn knowledge variables, starting temperature and its 
influence on heating and cooling was scored as pass or fail 

Administration and sewing of the swimming pool problem is described in Friedler, Nachmias, 
& Linn (in press). 

Results and Discussion 

In assessing version three of the CLP curriculum, we continued to find that domain knowledge 
was acquired, we were again able to effectively inqplement our plans, and we discovered that our 
efforts to incorporate principles of researeh into classroom instruction finally paid off in imparting 
increased integration of understanding. 

Domain Knowledge. In the third version of the curriculum, students again demonstrated 
understanding of the role of variables encountered in their experiments. As shown in Figure 4, 
students could effectively distinguish the role of insulation, starting temperature, mass, and surface 
area. Analysis ofperfoiman^ on the swimining pool problem revealed were quite 

proficient at controlling these variables when designing experiments to test the energy efficiency of 
various swimming pool designs (see Friedler, Nachmias, & Lirui, in press). 

Implementation. The observation and prediction conditions were implemented effectively. 
On the swimming pool problem, students in the obsenration condition made considerably more 
observations during their experiments, while students in the prediction condition made more 
accurate predictions of the outcomes of the experiment (Friedler, Nachmias, & Linn, in press). 

Student acquisition of prediction skill is apparent in Figure 7. Students initially had difficulty 
predicting results for heating or cooling experiments. In the case of heating, encountered first in 
the curriculum, predictions became quite successful after a few trials. Although this skill was not 
immediately generalized to cooling experiments, there were savings. Experience with heating 
shortened the time required to make accurate predictions for cooling. As can be seen, after two 
experiments almost all the subjects learned to make accurate predictions for cooling. This lack of 
immediate transfer illustrates the difficulty in generalizing these complex ideas to new situations. 

Integrating understanding. Both prediction and observation significantly influenced 
ability to integrate understanding of heat energy and temperature (semester 1 versus 3, F(l, 
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213>i3.0, p£*0002)» resulting in a two*foId increase in students who were able to meet the strong 
heat energy and temperature distinction criteria (see Figure 6). Furthermore, the prediction 
conditbn was significantly more efifective than the observation condition in achieving integration of 
understanding (F(l, 101)«6^, p<.01). Analysis of specific responses revealed several trends. 
Hrst, students did not refer to calories and degrees centigrade because quantitative models were not 
introduced Seccmd, students in the observation condition were more likely to give explanations 
tiiat emphasized descriptive aspects of tiieir experiments such as, 'Hliey are the same because heat 
energy is if it's hot or cold and temperature is just leveling out for you,** while students in the 
prediction condition were more likely to give integrated e3q)lanations such as, '^A piece of pizza 
miglit have the same temperature as a whole pizza, but not as mudi heat energy, because a whole 
pizza is bigger and has much more mass and heat energy.*" Third, most of the shidents ^5%) had 
some idea ^bout the distinction between heat energy and temperature, con^ared to 87% for 
version 2. 

As can be seen in Figure 6,.both prediction and observation increased student abili^ to meet 
the strong criterion for distinguishing heat energy and temperature. Looking at the weak criteria, 
we see that only predicticm irfcreased student ability to meet the "good" criteria. Thus, observation 
was most helpful for students who had attained quite sophisticated understanding, but it did not 
help the others. It appears that observation helps those who know what to look for but does not 
help othen. It may be that students can integrate the information firom observations only when 
they have a structure to guide their activities. 

Thus, both prediction and'^bservation enhanced students' ability to distinguish heat energy and 
temperature and therefore their ability to build a robust understanding of thermodynamics. If 
observation and prediction are effective separately, would students leam more about heat energy 
and temperature with both? 

The Computer as Lab Partner: Version Four 
To encourage integration of understanding as well as self-monitoring, we combined 
observation and prediction in version four of the Computer as Lab Partner curriculum If both 
observation and prediction encourage active learning and self-monitoring when used separately, 
together they might have a greater impaa. Altcmatively, would employing both observation and 
prediction overload students and distract them from learning the material? Version four ot ihe 
curriculum investigates this question. 
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In addition, a common concern is how easily other instnictors can use new cunicola. 
Conveniently, for version four, a student teacher took over two of the four classes, allowing us to 
detemiine whether the CLP curriculum could be used by other instructors. 

Method 

Activities. Venion four of the curriculum was identical to version tiiree of tiie cuniculum, 
txcept tiiat each activiQr was lewiinen to include both observation and prediction. Naturally, by 
including both components, it W2 necessary to shorten the time spent on each. 

Assessment Evaluation instruments used for version four were the same as those used for 
version tiuee. In addition, since the curriculum now helped over half the snidents to distinguish 
heat energy from temperature, we assessed the transfer of this understanding to naturally-occurring 
problems. We measured spontaneous transfer to these problems since no e]q)licit instruction was 
devoted to nahiraUy-occmring problems. To measure transfer, a survey of students' ability to 
interpret naturally-occurring problems was added to the evaluaticHi battery. 



Scoring. The naturally-occuning problems were scored pass or fail 



Res Jits 

In assessing version four of the CLP cuxriculuni, we again found that students had masteitd 
the domain knowledge, we assessed whether the student teacher was as effeSve as the regular 
teacher, and we found that integrated understanding w9S sustained when botl^bservation and 
prediction were combined / 

Domain Knowledge. As was the case for earlier versions of the curricilLUn, students 
accurately explained how each variable influenced heating and cooling (Figure |), In addition, 
students could give convincing exan^les to illustrate their views about heat ene|[y and temperature 
(see Table 4). 

On the swimming pool problem, performance of students in version four pal[llclcd that of 
students in version three. However, classes performed equally on observation aril prediction since 
all students learned both techriiques. 

Effect of Teacher, Outcomes for classes taught by the regular teacher did n<l differ from 
Aose taught by the student teacher. This evidence indicates that the curriculum can Jlperalize 
different instructors. 

Integrated understanding. The combination of observation and prediction incr? 
students* ability to distinguish heat energy from temperature (semester 2 versus 4 F(l, 
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P1.00Q2). As shovvn in Bgure S. students in version four were significandy more successful at 
distinguishing heat eneigy and temperstiue dian those in die observation condition, but not more 
successful dum diose in die prediction condition from version diree. Analysis of smdent responses 
to die question about distinguishing heat energy and temperature revealed diat students had 
reasonably integrated understanding of the c(»icq>ts. 

Two txnds are notable. First, numerous smdents were beguiled by an erroneous idea diat 
emerged from die discusaon ci a texdxxdc definiti<» for die distinction between heat energy and 
tempenuure. Overall, 19.4% of die students responoed. Heat is all kinetic energy, temperature is 
the avenge.** Again, students acted as cognitive eccmomists, prefierring a simple, available 
explanation diat diey did not completely understand. Second, very few snidents (1 1.2%) were 
completely wrong in their respcmse to die question about heat energy and tenqierature - fewer dum 
had been wrong in die past 

Overall, diere was a fourfold increase in deep understanding of heat energy and temperamre 
andar jold increase in adequate undentanding of the instruction. Qearly, curriculum 
refoncailatim can substantially improve learning even when the current constraints of instruction 
such as die 30-snident classriQid 55*minute class period are sustained. 

Naturally-occurring problems. Assessment of students* ability to transfer dieir 
understanding of heat energy and temperature to naturally-occurring problems paralleled results for 
odier transfer studies and are discussed m detail elsewhere (Songer & Linn, 1988a). Essentially, 
ability to apply concepts of heat " agy and temperature to classroom e^qieriments does not help 
Students apply this knowledg/ to naturaUy-occuning problems. Students perceive naturally- 
occurring problems involving heat energy and temperature as being distinct from those studied in 
class and therefore do not apply the concq)ts learned in class to the nanirally-occurring problems. 

Discussion 

By reformulating the CLP curricula, we were able to effectively incorpo le principles from 
research on learning and instruction and to document how these worlc in a realistic setting for a 
largp population of students. The observation and prediction conditions were used to implement 
research demonstrating that learners actively construct an understanding of the material world The 
choice of a heat flow representation reflected research on mental models. Onba'' ^e, these 
principles were not sufficient to impart integrated understanding to all stuQ*;nts and did not result in 
generalization of understanding to naturally-occurring problems. 
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Active Learner* How did the observadon condidon implemented in versions thite and four 
of the curriculum take advantage of the acdve nature of the learner and help studen;^ acquire deep 
understanding of the distinction between heat energy and temperature? Inrst> by acquiring detailed 
evidence about each experimentt students gained a naore concrete understanding of heat and 
temperature. For exanq)Ie. by observing charge in temperature from room temperature up to 
boiling point and nodng that« at die boiling point, the temperature does not change, students 
develop a cmtinuous representadon of heat change* We hypothesize that students are less likely to 
rqnesent a variable condnuously when diey set up die eaqieriment and then locdc at the graph. 
Radier, they may focus primarily on the endpoints of die experiment 

How did die prediction cmdition take advantage of the active nature of die learner and 
influence students* ability to integrate their understanding? Skill in prediction involves using 
domain*specific knowlei^f ^. When first encountering a new variable, students are unlikely to 
make effective predictions. However, when required to use feedback from experiments, students 
make reasonable predictions and determine a practical application for the knowledge. Self- 
monitoring was certainly exihanced by requiring students to reconcile their predictions with die 
results of their experiments^ "Students* comments, when writing explanations for die differences 
between their predictions and dieir results, clearly indicated that they were reflecting on dieir own 
Aought processes. 

Should observation and prediction be combined? Bv :h observation and prediction take 
advantage of die active nature of the learner by encouraging integration of feedback and self- 
monitoring. Taken together, results for versions three and four of die CLP curriculum suggest that 
combining obseivation and prediction results in die most robust understanding of f icat energy and 
temperature. Although combining observation and prediction in version four was not significandy 
better dian prediction alone in version three for improving performance on the distinction between 
heat energy and temperature, students had more integrated ideas as a result of experiencing both 
conditions. In particular, students in the observation condition pay attention to details of the 
experiments that may consolidate their undersranding. For example, students who carefully 
observe boiling note when bubbles appear and relate this phenomenon to temperature change and 
state change. 

Mental models. While researchers agree diat students need powerful representations of 
scientific phenomena, ideal models have not been identified. Our investigations revealed that 
students readily accept superficial models and resist efforts to encourage deep understanding. 
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Thus students were satisfied with (a) computadon of changes in calories or degrees centigrade, (b) 
understanding die variables influencing heating and cooling sq)arately or (c) a scientific-sounding 
e3q)lanationdiey could not comprehend One solution to keq> students from adopting these 
inconq)lete e^lanations was not to offer them. Ultimately, however, effective self*monitoring 
skills should help students recognize when their explanations a*e incomplete or supeificiaL This is 
a goal for subsequent reforaiulation of the cuxriculum. Cuniculum develq)ers should be prepared 
for students seeking single answers, and ensure that instnzction encourages deep understanding. 

Robust understanding. In ^ite of the dramatic gains in student success from versions 
three and four of the CXP curriculum, many students still failed to gain deep understanding of heat 
energy and temperature. 

Nevertheless, tiiey learned a great deal compared to otiiers. Fint, altiiough some students had 
serious gaps in their knowledge of thermodynamics, tiiey have learned as much or more tiian 
young adults typically learn. Songer & Unn (1988b) show that they always perfonn better than 
17-year-olds in a national sample NAEP (1979). Second, ahuost all students have some 
understanding of die distinction between heat energy and temperature after instruction. Third, 
students have acquired understanding of die variables influencing rate of heating and cooling 
(Rgure 4). ' ' 

In spite of these gains,' few snidents achieved the robust understanding experts have of 
thermodynamics. Most students did not generalize their understanding of heat energy and 
temperature to naturally-occurriiig problems. Rather, they maintained that naturally-occuning 
problenos were governed by different principles such as those in Table 2. To achieve change, 
students need (a) an alternative view and (b) reason to replace their current perspective. Only by 
die third version of the curriculum bad many students acquired an alternative. In general, die 
models diat students developed differed from those of experts in diat diey were less integrated and 
could not be applied to naturally-occurring problems. Furthermore, the curriculum did not 
emphasize thermoconductivity or specific heat, two concepts prominent in naturally-occurring 
problems. In die future, we hope to motivate change by making naturally-occurring problems 
more accessible to experimentation and to impart more robust, integrated models of 
thermodynamics. 

Conclusions 

In conclusion, reformulation of the CLP curriculum, in light of research on learning and 
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instructioQ, succeeded on a broad range of goals. It helped students a) gain robust understanding 
of graph inteipretatioA-a sidll required in many standardized tests, b) evaluate coinputer-presented 
data, c) understand experimentation and d) distinguish heat energy and tem^^ For 
distinguishing heat energy and temperature, perfomsance doubled on the weak criteria, and 
increased fouifold oo the strong criteria as the result of refoimulaticms of the cuniculunL These 
investigations demonstrate that by changing the intdlectual demands on die students, but not the 
experiments or the software, substantial iniprovement in student understanding can result They 
provide support for using the principles of learning and instruction to guide curriculum design. 
They demonstrate a) the advantages of spending increased instructicmal time on one tqnc, b) die 
possibility of gmeraliziiig these results to other teachers and classes and c) the advantages of using 
research to improve practice in realistic settings, as well as some shortcomings and limitations of 
current research on instruction. 

Instructional Time 

The CLP curriculum demonstrated cognitive, motivational, and practical advantages of 

f 

spending increased instructional time on a few science topics. Inrst, the cognitive advantages 
included a) middle school students achieving understanding of heat energy and temperature and 
important scientific conc^ts at levels comparable to those of young adults, and b) almost universal 
understanding of an important scientific technique, the graphing of experimental results. In 
contrast, recent national reports indicate that the vast majority of middle school students gain 
virtually no knowledge of scientific concepts and principles fiom middle school courses. Second, 
deep coverage of scientific topics has the added benefit that students are highly engaged in their 
scientific experiments and have a remaricable level of task-cniented behavior. As might be 
expected, formal comment^ by students were overwhelmingly favorable. One student even 
commented that she hated the weekend because she couldn't work with the computer in science 
class. The vast majoriQr of students indicated that science was their favorite subject while the 
Computer as Lab Partner curriculum was offered. 

Third, the increased instructional time qient on theimodynamics in the CLP curriculum had the 
practical advantage of providing learning likely to contribute to good sumdardized test 
performance. Qcarly, improved understanding of graphing will help students on a broad range of 
stands dized test items. In addition, evaluations of the hands-on curricula developed in the 1960*s 
tiiat also featured deeper coverage of a smaller number of topics revealed that these curricula 
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prq^axtd students fcsr standaxdized tests 

(Shymansky, Kyle, & Alportt 1982), no doubt, in part, because students gained integrated 
understanding <tf some aspects of science. 

These practical advantages spending considerable instructional time on a few scientific topics 
ccmtradict die many state guidelines listing numerous topics, the textbook emphasis on numerous 
tq)ics (thermodynamics is typically covered in one week), and the ostensible focus on many topics 
of state testing programs. Yet, we argue diat the recommendation to cover a wide range of tqpics 
is in conflict with the goals of instilling uerent understanding of scientific phenomena and 
encourages students to believe diat scic^we consists of a collection of unrelated facts. 

Generalizing to other classes 

These investigations provide evidence for the possibility of generalizing this curriculum to 
different populations. When the student teacher was folly responsible for two of the four classes, 
the curriculum was just as effective as when the master teacher presented it Yet, few training 
programs are as intensive as student teaching. Our observations suggest diat die intricacies of real- 
time data collection are easiest for teachers familiar with hands-on learning and that the process of 
modeling self-monitoring strategies required botii domain knowledge and considerable trial and 
refinement in the classroom. To encourage this approach, the teacher has provided workshops for 
over a thousand teachers.^ Response to his techniques has been overwhelmingly favorable. 

^ Curriculum Reformulation 



Our investigations demonstrated that curriculum reformulation, guided by principles from 
learning and instruction, is reasonable and effective for improving instruction in realistic settings. 
Investigations conducted in realistic settings have constraints but also offer opporhmities. For 
example, the 55-minute class period required the developers to abandon some plans but the use of 
real-time data collection made the class period more efficient. A similar approach has been used 
successfully by others developing curriculum materials. Brown's (Brown & Palinscar, 1987) 
reading comprehension instruction was developed through numerous reformulations of the 
reciprocal teaching technique. Anderson's tutoring programs for LISP, Algetn^ and Geometry 
were initially devised to reflect the ACT* theory but have undergone transfomiations following 
realistic trials in classrooms. Earlier work in science education and reading reveals benefits of 
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curriculum reformulation in many domains (see Karplus* 1975; Tharpt et al., 1984). This paper 
illustrates the promise and limitations of using principles of learning and instruction for curriculum 
leformulation. 

Promise of Principles of Learning and Instruction 

FimdamentaUyt the omtinuous improvement in learning outcomes as the result of curriculum 
reformulation suggests that the educational principles gDveming refinenoent have value. Hiese 
principles ace sufficient to establish a progressing research program in die terms of Lakatos (1972). 
Furtherroore* as discussed above, Aey suggest directions for continued refinement . 

Two principles led to a two- to four-fold gain (depending on die criteria employed) in abiliQr to 
distinguish heat energy and tenq)erature. Hie first was to channel the active* constructing nature of 
die learner to integrate information fiom a series of experiments. The second was to model and 
encourage self*monitoring skills. The development team translated these principles into an 
emphasis on predicting results and observing outcomes during experimentation. Essentially these 
are the activities performed by expen scientists when they conduct experiments. Howevert 
guidance fiom the principl^ of research helped the developers select, fiom among the many 
behaviors of experts, those likely to help students integrate their experiences. In addition, the 
principles of research emphasized the mode of instructional delivery. Both of diese principles 
made it clear that studenu rnust be guided to actively analyze their experiences rather than be told 
what the experiences mean. These principles suggest that students should not read about the 
distincticm between heat ener^ and temperature, but rather figure out this distinction by combining 
information fiom a series of experiments, and by analyzing and refining their own ideas. 

Limitations of Principles of Learning and Instruction 

Efibrts at currculum reformulation also revealed some shortcomings of instructionai research 
and suggested some directions for refinement of principles. Although many believe that students * 
benefit from multiple representations of the same phenomena, and wt af;gued that real-time data 
collection may help students because it provides another representation of the same phenomena, 
our experience suggests that this principle requires refinement We initially provided multiple 
representations of the distinction between heat energy and temperature. We found that rathor than 
integrating these separate representations, students chose the one they found easiest to learn. Many 
students focused on what could be called the ^'measurement distinction** and concluded that heat 
was calories and temperature was degrees centigrade. When we omitted this option, more students 
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acqmrcd sqfrfiisticated eaylanations. 

Sevend conjectures for rescazcli axe suggested by this fi^^ Onehypodiesisisthatthe 
muldple rqnesentaiions needed integraticm and that students would benefit from several 
e)q>lanations for the distinction, including die noeasurement distincticHi, if they were required to 
map one explanaticm on to the other. This is the hypothesis White and Frederickson (1987) 
tepnscntcd in their progressicms of mental models. However, as yet no evidence exists for 
proccdmes dua succeed in achieving integration. 

Anodier conjecture is timt some explanations form poor nientaln This view says Aat the 
measurement distincticxi is incomplete (and does throw a veil of numbers over the important 
informaticm) because it does not explain the phenomenon under investigation. This is the point of 
work comparing mental models (Collins & (jentner, 1983). This coiyecture is also consistent widi 
die effectiveness of die dynamic representation conununicated by real-time data collection. In 
summary, our efforts at curriculum refinement revealed that multiple rqmsentations do not always 
advance learning. 

/ jiother educational principle that requires refinement concerns the role of domain knowledge 
in reasoning. Researchers tiave argued that reasoning has important domain-specific components 
that must be addressed in instruction. Our investigations suggest that domain knowledge is far 
fiom sufficient for learning about complex concepts like heat encigy and temperature. Students 
readily mastered die role of variables such as surface area, insulation, starting temperature, and 
mass in heating and cooling but did noi improve in ability to distinguish between heat energy and 
temperature. Students acquired understanding of these variables much as they acquire isolated 
information from textbooks and failed to apply it to more complex problems. The skills students 
use to learn about the variables are not sufficient for understanding die distinction between heat 
energy and temperature. This distinction was only acquired when students were required to 
combine the isolated experiments that yielded informadon about each of die variables in die 
domain. 

It appears that students interpret science incorrecdy when lots of domain knowledge is present, 
and assume diat science consists of memorizing this informadon instead of understanding the 
principles that lead to the information. This conjecture is consistent with research showing that 
students learn the formulas for elementary mechanics rather than learning the principles that govern 
the formulas (Larkin, et al., 1980) and that students learn the syntax of programming rather than 
design skills (Linn, 1985). This hypothesis raises several research questions. Rrst, to encourage 
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understanding, instruction could emphasize self-monitoiing skills and expliddy show duu die 
domain knowledge is not sufficient for understanding: Altemativdy, insoucdon couU txpiod die 
notion of domain knowledge and teach much more complex tenylates or procedures for solving 
pioUems. Ultimately the nature ind boimdaries of domain knowledge become issues. 

A final limitation of principles of learning and instruction for curriculum refinement concerns 
precision. Conent principles axe not sufficiendy developed to provule answers to questions 
concerning choice of topic* duration instraction, classroom orgamzation, etc. Furthermore the 
fidd itself suffers from domain specificity. Gomnaooly, principles concerned widi classroom 
management are unintegrated wxdi principles of learning. Presumably, efforts a! curriculum 
refinement will he^ to resolve some of diese questions and integrate some domains of knowledge. 

Conddering diat understanding of principles of instruction is just emerging, it is encouraging 
diat some indghts from research can be used tt> guide curriculum design. A closer coupling 
between research on instruction and experience in realistic settings offers promise. HieCentersfor 
Collaboration on Science Educatim proposed by many recent national groups (e.g., Unn, 1987; 
Pea and Soloway, 1987) would foster effective curriculum reformulation projects by bringing 
togetiier all those cracemed about effective instruction. 

Overall, the investigatidis reported here look broadly at instruction, and die resulting 
recommendations are reasonably general There remain multiple explanations for die outcomes 
because the teaching situa[tion is complex. However, use of curriculum reformulation suggests 
mechanisms that govern learning, and offers possibilides for replication and extension. Combined 
with similar efforts, diese investigations promise a systematic understanding of Ieh.ning in realistic 
settings. 
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Table 1: Curriculum Over Four Semesters 
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TABLE 2 

Naturally-Occurring Ideas About Thermodynamics 



1. "Your cup of hot chocolate is larger, so yours has a higner temperature." 

2. "You only have a temperature if>ou are sick." 

3. "TTie ice cools the water." 

4. "It's cooler in the shade." 

5. "It's hot on the asphalt, so walk on the grass." 

6. "Metal attracts coolness." 

7. "Larger ice cubes are cooler than small ones." 

8. "Wood absorbs heat It's cool outside but warm inside." 

. '< 
* ^ 
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TABLL i Alternative Representations of Heat Energy and 

Temperature Distinction 

1. Measurement 

Heat change is measured in caiories, temperature change is measure in degrees 
centigrade or fahrenhe.*. 

2. Variables 

Heat and temperature changes are influenced by mass of substance, surface 
area of substance, presence ofinsuiators around substance, and starting 
temperature of substance relative to surround. 

3. Kinetic Theory 
Heat is transferred by the collision of particles between substances in phystical 
contact until equilibrium is achieved. The total heat energy present in an object 
is a function of the number of particles present in the object and the object's 
temperature. Temperature is a quantitative measure of the average energy of 
motion per particle within a substance. 

/! 4. Heat Flow 

Heat is distributed in substances and flows from wanner to cooler substances 
'mtil equilibrium is reached. Heat lacks mass. Temperature is a measure of the 
ii.iensity at a given point. 
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TABLE 4: Sample Responses to the Heat Energy/Temperature Distinction Question, "in general, are Heat 
Energy and Temperature the same or different? What is the mah reason for their similarity or 
difference?** 

1. Very good distinction 

"the amount of heat energy In something keeps it at a temperature. A larger object reeds more heat energy to 
keep It at a certain temperature than a smaller object needs to keep it at the same temperature. A glass of water 
at 20*'C has less heat energy than full bathtub at 20X because it has less water." 

temperature defined as-a measure to see how hot or coM an object Is. heat energy-amount of heat and 
energy an object has measured In calories. The more mass the more heat energy an object will have, even if the 
temp, of the object doesnl change. A piece of pizza might have the same temp, as a whole pizza, but not as 
much heat energy, because a whole pizza Is bigger and has much more mass and heat energy. 

2. Complete distinction 

"The difference between heat and temperature Is there ca.^ be more heat in a cup than in another but both are 
the same temperature. If there were two cups one with 100 ml and one with 20 ml they can both be still SO^'C." 

3. Some distinction 

"Heat Is an amount of energy expressed In calories. Temperature is the degree at which something is. For 
example, an Ice cube may be OX but it still has and gives off heat energy." 

4. Single Themnal distinction 
"Temperature Is the measure of heat energy" 

"Heat Is like a fire burning and temperature is to tell how hot the fire is." 

5. TexttXHik definition/Terms only ' . 

"heat Is Hid total kenetic energy in the area. Temp, is the average kenetic energy in the area." 
"temperature is measured in *>C heat energy is measured by calories." 

6. Confused/Wrong/lncomplete 

"The difference between heat and temperature Is like a baby's bottle is hot with heat and when a baby is sick 
he has a temperature." 

7. No tesponso 4 4 
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TABUES 

Swnpto Pradldion and Observation Activity QuMtlora 



Smnpk Pf9dhlhfi AdMy QumHom: Gooing Wmt • Asr Bxpmimm 

in Mt • xp irima nt 200 ml of hot wMr «M bo aMowod to ooollo room tomporatim. Tho oompuitr wll rocord ttio f«omporaturt and 
«« drw fio graph. Bafoio doing ttio oicpariiiiam pcadtal aomo of t>o axpwiman^ At tho and of tttt •ipt/imont you will 



■afofo doing tlio oxporlmoirt givo y« ur piadtetion a for 

Tho walar imparalura at tho ha^inniny cn tm oxporlmont ^ 

Tho ivaiar tMnparaluro at Om tod of Om oxporlmont 

Tho chango In tha vokimo of tho waiar..- - ••...•....^ 

Tho langth of timo It w» taka tio vnaiar to oool.. 

Pfodkt what ttia graph wN look Oko (draw your pradMon balow) 



I 



Now do tho axparlmant 

For your lab raport plaaso draw tha graph from tho data you have racofded on tho graph papm^ and antvi'or tho cuestbns on Iho oOior 
tidoofthlopaga. 

Aflor doing tho oxpoHmont writa down which of your pradictioni you wora right, and which waro wrong. Try to explain why 

your prodlctlo nt waro wrong. 

I was right about* , / 

I was wrong about 

Why: 

My oond-*sions about ttia shapa of a cooing curvo of watwr sro: 

{inch:do information t oout tho initial ttmparatura of tha watar. whathar tha graph want up or down and at what rate. When the change 
ill temperature was fi^pld. when it was slow) 

Samp/^ Otesrvalto Ae^itjf CkmBthns: Cooling Wator - Fmt Exporlmont 
Cooling of Water 

In this e-perlmant 200 ml of hot watsr wiH be aHowad to cool to room temperature. The computer will record the temperature and 
win >aw ihe graph. While doing your experiment observe carefully and raport as many details as possible in your log. This log will 
be ooltected as your lab report 

Before heating the the watrr 

Report all the details you obsjwved concerning the experimental setup, such as: the volume of water, the descriptiun of ^he container 
eie. Describe also the conditions at the beginning of the experiments such as: air temperature, water temperature etc. 
draw: a sketch of your set up. 

While heating the the water 

. -y attention to the temperature change as well to any changes In the water condition (e.g. bubbles, change in the volurTie of the 
wa. r) 

Remember to report tttutt happens and wh^n it happens. 

Pay attention and report about the changes in the water condition In relation to the changes of your gr^h on the computer screen. 
After doing the experiment 

a) Draw the final graph you have on your screen on the graph paper. 

b) Describe how the temperature of the water changes. Start with reporting the initial temperature of the water, then describe 
whether the temperature went up or down and at what rate, when the change in • nperature was rapid, when it was slow and when 
Ae temperature was constant Report how long the experiment took and the temp .^ture of the water at the end of the experiment 

In the next perloda you will conduct experiments to Investigate the following questions: 

1. What is the effect of different volumes of water on ifs cooling rate. 

2. What is the effect of different insulators on waters' cooling rate. 

hi each on^i of these experiments write down a detailed log that will consist all the information mentioned above. 



EMC 
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FIGURE 1 Example of a Screen Display from an Evaporation 
Experiment Conducted with Real-Time Data Collection 
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FIGURE 2 Sample Students* Responses to a Question About 
Heat Energy and Temperature 



example 1 

"The difference between heat and temperature is like a baby's 
bottle is hot with heat and when a baby is sick he has a 

temperature" 



example 2 

Temperature registers everything but heat is the hot part. 

For example... 




Domain Knowledge Queiition About Volume 



1 . This graph shows the change in temperature when 100 ml of 80 water In 
gtflgfi beaker 1 is allowed to cool In a 23 *C room. It is labeled 'qm 'igeun/er 

[ Cooiinp Cufv»» for Watat j 




1 — -I r 

8 10 12 

TIME (mins) 



100 ml 





80 "C 

20 ml 



Beaker 1 



Beaker 2 



a) On the sarr.e graph, show the change in temperature for 20 ml of 80°C water 
which cools in g'gss beaker 2 in the same room. Label it 'coolir 



b) What is the main reasor. why ' coolinf 
as) "cooling curve g "? 



is different from (or the same 



c) What experience have you had (either an experiment from class, or an instance 
from everyday life) that convinces you of your answer? 

Heat Encgy and Temperature Assessment Question 

1 . a) In general, arc heat energy and temperature the same or different? 

(circle one) same different 

b) Vt/hat is the main reason for their similarity or difference? 

c) Give an example that explains your answer. 



Figure 3: Sample Questions 
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FIGURE 4 Students' Understanding of Four Variables 
Associated with Ciassroom Experiments 



□ baseline 

QSEMESTERl 
^SEMESTER 2 
B SEMESTERS 
|SEMESTER4 
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FIGURE 5: Weak Criteria for Heat Energy/Temperature Distinction 



80- 



60- 



O 



□ Baseline 
S Semester 1 
^ Semester 2 

■ Semester 3: Observation 
B Semester 3: Prediction 

■ Semester 4 



WRONG 




WEAK 
STUDENT RESPONSE 



C300D 
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Stronji Criteria for Heat Energy/Temperature Distinction 




Baseline Version 1 Version 2 Versions Version 4 
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Percent of Valid Predictions 




Name 

period 



Tlie Swimming Pool Activity 

In the next two periods you will be hired as an independent researcher by a swimming pool company. 
Tht company started to design a new series of swimming pools for customers all over Ae countsy. One 
very important factor of the design is how fast the water in various swimming pools cools. The question 
that the designers asked is: How does the surface area of a swimming pool affect the cooling rate of iu 
water? (surface area is the size of the surface of the water that is exposed to air). Of course they want the 
answer before building a real swimming pool. Your Job wiU be to design and carry out an experiment to 
answer this question. 

Your work wiU consist of two main parts. Hie first part will be done before you start the experiment and 
will include a plan of your experiment. The second part will be done during and after the experiment and 
will include a detailed log of your obsprvations and your conclusions from the experiment. 

Parti 

1. Do you think different surface areas will make a difference in cooling? If you do, what do you think 
will happen? 

2. If you graphed two pools cooling which have different surface areas, what do you think *he graph 
would look like? 

80 
60 

temperature 

•C 40 

20-- 



time 



Part 2 

Congratulations! Your plan has been approved by the swimming pool company and Ihey wani lo see the 
results of your experiment as soon as possible. They uill expect to see a graph of your results and would 
like you to submit a statement of your observations and your conclusions. 

Observations 

Comment on what your graph looked like. Was there one line or two? Were the lines straight or 
curved? If they were curved, when were they steepest? Did they get steeper or less steep as tijnc went 
one? Were there any sudden drops or rises? Vfhai was happening when tho^e drops occurred? Write 
your comments below. Don't just answer these questions. Write in full sentences. You can use these 
questions as guides to help you decide what to look for. Add anything else you think is important. 



Figure 8: The Swimming Pool Activity 
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